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A new fundamental solution for a class of 
differential Riccati equations* 

Peter M. Dower^ Huan Zhang! 


Abstract —A class of differential Riccati equations (DREs) is 
considered whereby the evolution of any solution can be identified 
with the propagation of a value function of a corresponding op¬ 
timal control problem arising in ^2-gain analysis. By exploiting 
the semigroup properties inherited from the attendant dynamic 
programming principle, a max-plus primal space fundamental 
solution semigroup of max-plus linear max-plus integral op¬ 
erators is developed that encapsulates all such value function 
propagations. Using this semigroup, a new one-parameter fun¬ 
damental solution semigroup of matrices is developed for the 
aforementioned class of DREs. It is demonstrated that this new 
semigroup can be used to compute particular solutions of these 
DREs, and to characterize finite escape times (shoufd they exist) 
in a reiativeiy simple way compared with that provided by the 
standard symplectic fundamental solution semigroup. 


I. INTRODUCTION 

Differential Riccati equations (DREs) arise naturally in 
linear optimal control and dissipative systems theory 0. SI. 
13, a. A typical finite dimensional DRE applicable in the 
verification of the ,2^-gain property for linear systems is an 
ordinary differential equation defined via matrices A £ R nxn , 
B € R nxrn , C € R pxr \ n,m,p£ N, by 

P t = A'P t + P t A + PtBB'Pt + C'G , (1) 

in which P t £ §" x n describes a particular symmetric matrix 
valued solution evolved forward from an initial condition 

Po G S^, (2) 

residing in the space of symmetric matrices exceeding some 
M £ S nxn , to any time t £ [0,f*) in some maximal horizon 
of existence t* = t*(Po) G R> 0 = R>o U {+ 00 }. Related 
DREs arise in linear J& 2 - and .y^A-control and filtering, etc, 
see for example S3, S3, E). 

A fundamental solution for DRE 0 is a mathematical 
object that characterizes every possible solution of that DRE, 
as parameterized by its initial (or terminal) condition ©. 
One such fundamental solution is the symplectic fundamental 
solution, which is itself the solution of a (derived) Hamiltonian 
system of linear ordinary differential equations, see for exam¬ 
ple 0 , 0 , 0 . Another fundamental solution is the max-plus 
dual-space fundamental solution 0, [8], |9|, [101, which is 
constructed by exploiting semiconvex duality CD and max- 
plus linearity of the Lax-Oleinik semigroup m of dynamic 
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programming evolution operators for an associated optimal 
control problem, see also H2l . Ifl3l . fl4l . 1131 . U6l . 

In this paper, a new max-plus primal space fundamental 
solution is provided for DREs of the form 0}, (0. This fun¬ 
damental solution can be used to evaluate particular solutions 
of Q. analogously to the symplectic and max-plus dual space 
fundamental solutions. Its development is complementary to 
that of the max-plus dual space fundamental solution docu¬ 
mented in 0, 0, ITOl . and parallels the corresponding recent 
primal space development for difference Riccati equations (9). 
It is shown that this new fundamental solution provides a 
simpler test for establishing existence of solutions of 0, 0 
when compared with the symplectic fundamental solution. 

In terms of organization, the symplectic fundamental so¬ 
lution for DRE 0 is recalled in Section [TT] for comparative 
purposes, to formalize existence of solutions, and to construct 
a specific particular solution to 0 of utility later. The max- 
plus primal space fundamental solution, and corresponding 
fundamental solution semigroup, is subsequently constructed 
in Sections [III] and II VI using the aforementioned particular 
solution. An illustration of its application is provided in 
Section m followed by some brief concluding remarks in 
Section [VI] Proofs are largely delayed to the appendices. 

Throughout, N, Q, R denote respectively the natural, ratio¬ 
nal, and real numbers, while R>o, R", R" xn denote respec¬ 
tively the nonnegative real numbers, //-dimensional Euclidean 
space, and the space of n x n matrices with real entries. R 1 * 1 , 
etc, denotes the analogous sets defined with respect to ex¬ 
tended reals RU {±oo}. Similarly, § nxn , S>£”, denote 
the spaces of symmetric, nonnegative symmetric, and positive 
definite symmetric elements of R” XTl respectively. Further 
extending this notation, denotes the subset of § nxrl of 

matrices P satisfying P — M £ §”q", etc. The transpose of 
P £ R” x " is denoted by P' £ R raxrl . The corresponding 
identity is denoted by I £ § nxn . Given U £ R 2rix2r \ the 
two-by-two block matrix representation 

_ r u 11 u 12 
u ~ [ u 21 v 22 

with U l i £ R" xrl , i,j £ {1,2}, is used where convenient. 

II. SYMPLECTIC FUNDAMENTAL SOLUTION 

Existence of a unique solution to DRE 0, subject to 
0, may be verified by application of Banach’s fixed point 
theorem, see for example 0 Theorem 2.4]. Alternatively, it 
may be constructed directly as 

Pt = YtXf 1 


(3) 


(4) 




in which X t . Y t £ R” xn are defined with respect to the 
symplectic fundamental solution £ t £ R 2nx2n for © by 


’ x t ' 


I 

. Y t . 

— 

. p o . 


£ t = exp (Hi), H = 


f e[0,f*(P o )), 

-A -BB' ' 
C'C A! 


(5) 


in which the maximal horizon of existence t*(Po) £ R> 0 of 
the unique particular solution P t in © is characterized by 


t*(Po) = sup < 

t £ R>o 

Xfi 1 exists V s £ (0,t] \ 
with X s given by © 


l 

subject to P 0 € § nxn J 


see a, ini. os. This maximal horizon of existence is either 
strictly positive and finite, or infinite. Where t* (If) is strictly 
positive, the solution Pt experiences a finite escape at t = 
f*(Po). Otherwise, no such such finite escape time exists, and 
P t may be evolved to any arbitrarily large time horizon t £ 
R>o. For example, under the conditions of the strict bounded 
real lemma (e.g. 0 Theorem 2.1] or 0 Theorem 3.7.4]), 
P 0 = 0 £ S nxn implies that t*(P 0 ) = +oo. 

By inspection, the symplectic fundamental solution £t, 
defined by Q. (©. @ satisfies the properties of a fundamental 
solution for DRE (|TJ>. In particular, it can be evolved indepen¬ 
dently of any specific DRE initial condition Po, and can be 
used to recover any such particular solution via an operation 
involving that If. It is a standard tool for the representation 
and computation of solutions to DREs of the form ([T]). In 
Section uni it is used to construct a particular solution of a 
DRE of the form (jTJ that is employed in the construction the 
max-plus primal space fundamental solution of interest. 


III. MAX-PLUS FUNDAMENTAL SOLUTION 


A. Max-plus algebra and semiconvex duality 

The max-plus algebra fl2l . S3 is a commutative semifield 
over R _ , equipped with addition and multiplication operators 
defined respectively by a ® b = max(a, b) and a®b = a + b. 
It is an idempotent algebra, as the © operation is idempotent 
(i.e. a © a = a), and a semifield as additive inverses do not 
exist. The max-plus integral of a function / : 1" —> R~ over a 
subset Cl" of its domain is f(y) dy = sup, yg ^ f(y)- 
The max-plus delta function T : 1“ x K" ^ R _ is defined 
for all x, y £ R” by 


6 (x,y) 


0, x = y, 
-00 , x ± y . 


(7) 


In developing a max-plus fundamental solution, it is useful to 
introduce spaces of uniformly semiconvex and semiconcave 
functions, defined with respect to K £ § nxn , by 


fi K 


y K = 



/ : R" —>■ R _ 

/+§(-, K-) \ 


convex J 


a : R" ^ R- 

a ~ \ <•> K -) j 

1 

L 

concave J 


( 8 ) 


respectively. Semiconvex duality is a duality between these 
spaces of semiconvex and semiconcave functions, that is 


established via the semiconvex transform EE). The semicon¬ 
vex transform is a generalization of the Legendre-Fenchel 
transform 021, M, ED, in which convexity is weakened to 
semiconvexity via a quadratic basis function ip : R” xl" —>• R. 
This basis function is defined for all x, z £ R" by 


ip(x, z) = i (x — z)'M(x — z) = \ 


X 

z 


p(M) 


X 

z 


(9) 


in which M £ § nx ", and p : S nxn —» § 2nx2n i s defined by 


p(P) = 


+P -M 
-M +M 


^ g2nx2n 


( 10 ) 


for all P £ S nxn . 

Assumption 3.1: Matrix M £ § nxn defining the basis (0 
satisfies the following properties: 

1) M~ l £ § raxn exists; 

2) t*(M) = +oo, cfi ©. 

Standard conditions under which Assumption 13.11 holds 
are controllability and observability of (A, B) and (C, A) 
respectively, or via the strict bounded real lemma, see for 
example 0. The details are postponed to Lemma [3.41 

The semiconvex transform and its inverse are well-defined 
with respect to the basis p of © by 


/*® 

'D lp 4> = -\ <p(x, •) <S> (—if)(x)) dx , (11) 

J R n 

/*® 

V v 1(1 = +(■, z) © a(z) dz , (12) 

JR n 

for all if) £ dom (Z?^) = and a £ dom ifDf, 1 ) = SAp M , 

see also M, Q, S3, G2. For quadratic functions, CD and 
(]T2l i define a pair of matrix operations on corresponding spaces 
of Hessians. In particular, with ip : R” —x R defined with 
respect to some P £ by ip{x) = \x'Px for all x £ R", 
application of (fill ) yields a well-defined semiconvex dual. In 
particular, a(z) = \z'T{P)z for all z £ R", with T : $ nxn —» 
S nxn defined by 

T(P) = -M - M(P - P £ dom (T), 

dom (T) = S^. (13) 

Similarly, the inverse semiconvex transform (fl2l i corresponds 
to the inverse map T -1 , with 

T“ 1 (P) = M- M(P + M)~ 1 M, P £ dom (T _1 ), 
dom (T- 1 ) = . (14) 


Remark 3.2: The domains specified in (fl3l ) and ( 1 1 4] may be 
extended to Afiff and respectively, via corresponding 

Moore-Penrose pseudo-inverses. However, this extension is 
not required here, and the details are omitted. 


B. Optimal control problem 

In order to construct a max-plus fundamental solution for 
the propagation of solutions of DRE (©. ©, it is useful to 
define a corresponding optimal control problem on a finite 
















time horizon t G R>o via the value function W t : R" —s> R 
given by 

W t (a) = ($*)(*) (15) 


for all x € R n . Here, 'I' : R™ —> R denotes the terminal payoff 
'T (x) = \x'Pq x for all x £ R”, in which P 0 G is as per 
©, with M G S nxn as per 0. The dynamic programming 
evolution operator St appearing in (fl5l i is defined by 


(S t ip)(x) = sup J^(t,x,w), ip G dom (<St), 


dom (S t ) 


: R" —>• R~ 


(S t ip)(x) G R 
Viei" 


(16) 


for all x G R". Payoff J^(t, •, •) : R” x Jf 2 ([0, t]; R m ) R" 

is defined by 


J^(t,x,w) = [ \\y s \ 2 - ±\w s \ 2 ds + tp(x t ) (17) 
Jo 

for all x G R”, w G Jz?2([0,f];R m ), in which x s G R n , 
w s G R m , and y s G R p denote the state, input, and output 
(respectively) of the linear system 

x s = Ax s + Bw s , Xn = x G R ra , 

’ (18) 
Vs = Cx s , 

at time s G [0,f]. It is straightforward to show that the value 
function Wt of (fl5l) is quadratic, see ED, G), 0, 0. with 

W t (x) = (S t ^)(x) = \x'P t x (19) 

for all x G R”, with P t G § 2 " x2n satisfying DRE 0} subject 
to the initial condition 0. 


C. Auxiliary optimal control problem 

It constructing a max-plus fundamental solution for ([TJ, it 
is useful to introduce an auxiliary optimal control problem 
defined on the same finite time horizon t G R>o with value 
function S t (-,z) : R” —> R, z G R n , defined in terms of the 
dynamic programming evolution operator St of (fl6] > by 

S t (x, z) = (S t p(-, z))(x) (20) 


for all x G R". This value function is again quadratic, with 


S t (x,z) = \ 


! 



( 21 ) 


for all i,zG R", in which Q t G S 2nx2n is the unique solution 
of the DRE 


Qt — A!Qt + QtA + Qt BB'Qt + C'C (22) 


initialized with 


Qo = li(M) G R 2rax2n (23) 


as per 0, (flOb . for all t G [0,f*(Qo)). Here, t*(Qo) G R> 0 
denotes the corresponding maximal horizon of existence 0, 
while the constant matrices A G K 2rax2ra , B G R 2raxm , and 
C G R px2n appearing in (l22l > are defined by 


A = 


A 0 
0 0 ’ 


B = 


B 

0 ’ 


C=[C 0 ]. (24) 


Equivalently, using the notation of 0, DRE (l22l >. < 123 b implies 


that Q t n ,Q 22 G § nxn , Q\ 2 G R" xn satisfy 

Qt 1 = A'Ql 1 + Q] 1 A + Q^BB'Q] 1 + C'C, (25) 

Qt 2 = (A + BB'Ql'YQl 2 , Q \ 1 = (Ql 2 )', (26) 

Q 22 = o QrysB'Qi 2 , (27) 

for all t G [0 ,t*(M)), subject to Qj 1 = — Qj 2 = Qg 2 = M, 


with M G S nxn as per 0. As (f26l and ( l27l> describe 
(respectively) a linear evolution equation and an integration, 
any finite escape of Q t must be due to the dynamics (l25l >. see 
for example ll23l Proposition 3.6(iv)]. That is, the maximal 
horizon of existence for (l22l> and (l25l > must be equal, ie. 
t*(Qo) = t*(M). Assumption 13. II further implies that 

t*(Qo) = t*(M) = +oo. (28) 

As DRE (l25l > is of the same form as 0. the particular solution 
Qt of DRE (l22l >. < 123 b can be characterized explicitly via the 
symplectic fundamental solution 0. 

Theorem 3.3: Under Assumption 13.11 the particular solu¬ 
tion Q t of DRE (l22l> . (123b and the symplectic fundamental 
solution E t of 0 for DRE 0 are equivalent. That is, there 
exists an invertible operator S : § 2nx2n —». S 2nx2 n such that 

Q t = H(E t ), E t=E~ 1 (Q t ) (29) 

for all t G R>o- 

Proof: See Appendix lAl ■ 

Theorem 13.31 demonstrates that under the conditions of 
Assumption 13.11 any particular solution of the DRE 0, 0 
can be represented equivalently by the symplectic fundamental 
solution Et of 0, or via the Hessian Q t of the quadratic value 
function of the auxiliary optimal control problem <l20l >. (|2TI >. 
see <l29l >. Consequently, the following sufficient condition for 
Assumption 13. II is useful. 

Lemma 3.4: Suppose there exists a stabilizing solution 
Mq G §>o of the algebraic Riccati equation (ARE) 

0 = A' M 0 + M 0 A + MqBB'Mq + C'C. (30) 
Then, there always exists an invertible M G S nxn satisfying 

M — Mq G §"o”, (31) 

such that Assumption 13. II holds. 

Proof: See Appendix |B] ■ 

Remark 3.5: Lemma [3~4l provides a constructive approach 
to validating Assumption 13.11 directly. It also enables indirect 
validation via the bounded and strict bounded real lemmas, see 
for example 0. In particular, stability of A, controllability of 
(A, B), observability of (C, A), and the finite gain property 
11(21,5,67)11^ < 1 imply via the bounded real lemma that 
Assumption 13.11 holds. Alternatively, stability of A and the 
strict gain property ||(A, B, C)\\jg> oo < 1 imply via the strict 
bounded real lemma that Assumption 13. II holds. 

D. Max-plus integral operator representations for m 

A horizon indexed max-plus linear max-plus integral oper¬ 
ator defined on a space PP is an operator of the form 



Ft(-,ui) <g> 7T o Xt(-,w) du) , 7T G dom (J 7 ®), 











dom (J?) 


<^7T : & —► K 


G R" 

Vier 


(32) 


where F t : R" x SP — > MG denotes the kernel of the operator, 
Xt ■ R n x PP —\ R n is an auxiliary operator (included here 
for generality), and n G dom (Ff) is the function-valued 
argument of Ff representing a terminal payoff (or value 
function) or its semiconvex dual. The dynamic programming 
evolution operator St of (ITTTb defines a max-plus linear max- 
plus integral operator of this form, with 


£? = -S?2 ([0, i]; R m ) 

F t (x,w) = I t (x,w) 


Xt(x,w) = x t , 



w s 


1 ds, 


where It(x, w) is the integrated running payoff associated with 
initial state x G R" and input w G Jz?2([0, t]; R m ) over the 
horizon t G R>o, and Xt G R" is the corresponding terminal 
state, both defined with respect to (fT8l >. That is, for all x G R™, 

/*© 

(S t ip)(x) = / I t (x, w) ® ip(x t ) dw . (33) 

Xs? 2 ([0,t];R m ) 

Similarly, recalling the definition © of the max-plus delta 
function S~, the identity max-plus linear max-plus integral 
operator on FP = R ra , defined via Xt(x, y) = y G R n , is 


(X® ip)(x) 


S (x, y) <8> ip(y) dy , (34) 


for all x G R", ie. I®ip = ip for any ip G dom ( X ®), in which 
the domain dom (X®) is defined as per d32l ). 

Theorem 3.6: Under Assumption 13.11 and given the dy¬ 
namic programming evolution operator St of (fl6] > with t G 
R>o fixed, there exists a max-plus linear max-plus integral 
operator Gf of the form ( 1321 such that 


S t ip 



Gt{-,y)®ip(y)dy, 


dom (Gf) A dom (S t ), 


V ip G dom (Gf), 
(35) 


with kernel G t : R" x R" -> 1 defined for all x,y £ R n by 


G t (x,y) = (S t 6 ( m ,y))(x) = {'D v> S t (x,-))(y), (36) 

with respect to ©. ( flTb . ( IT6l >. ( l20l >. 

Proof: Fix arbitrary t G R>o and x,y G R". Recalling 
the definition (l20l >. (ITil of St, 

S t (x, y) = (S t ip(-, y))(x) = \x'Qfx + x'Q) 2 y + \y'Ql 2 y, 

wherein Assumption 13.11 and (l27l > imply that 

Qf G Km- (37) 

Consequently, by definition ( fTTb of the semiconvex transform, 

S t (x, •) G dom (Vcp) = so that 

G t (x, •) = V v S t {x, •) G yi M = dom (Vf 1 ) (38) 

is well-defined. Note in particular that Gt(x,y) G R _ by 
definition © of SPZ M ■ As t G R>o and x,y G R" are 
arbitrary, a max-plus linear max-plus integral operator Gf 


of the form (l32l > is well-defined by the kernel Gt of ( 1331 . 
Recalling the definitions (fl2l >. (1201 . 1341 of T >~ 1 , St, X®, 


S t (x,y) = (S t </?(•, y))(x) = (S t l® ip(-,y))(x) 

r@ 


/jS? 2 ([0,t];R m ) 

/■© 


It(x,w) <g> 


6 (x t ,£) ®tp(£,y)d£ 


dw 


/R n 


!St ? 2 ([0,t];R m ) 


I t (x,w)®6 (xt,0 dw 


®<p(€,y)d£ 


= [ (StS (■,Q)(x)®tp(£,y)dt; 

JR n 


<p(y,£)®{s t s (-,0)(x)d£ 


= (V~ 1 T t (x,-))(y) 


(39) 


where the interchange of max-plus integrals involved corre¬ 
sponds to an interchange of suprema, the second last equal¬ 
ity follows by symmetry of ip, ie. <p(£, y) = <p(y, £), and 
T t (x,y) = (S t S~(-,y))(x). Hence, substituting 09l > in (l38l >. 

G t (x, •) = D v S t (x, •) = T> v V- 1 T t {x, •) = T t (x, ■). 

That is. (l36l > holds. Furthermore, for any ip G dom (St), a 
similar argument yields 


(S t ip)(x) = (5jX® ip)(x) 


/^f 2 ([0,t];R m ) 


se 2 ([o ,t] ; : 


It(x,w) 


/*© 

/ 5~{x u y)®^{y)dy 
J R n 


dw 


I t (x,w)®5 (x t ,y)dw 


®ip(y)dy 


/*© /*© 

= / (StS~(-,y))(x)®ip(y)dy = G t (x,y) <g> ip(y) dy 
J R n J R n 

= (G?iP)(x). 


That is. (l35l > holds. ■ 

Remark 3.7: The kernel Gt of the max-plus linear max-plus 
integral operator Gf defined in Theorem 13.61 can be bounded 
above by the value function of a third optimal control problem. 
In particular, applying ( [36b . 


G t (x,y) = (S t S (-,y))<(S t ip 0 )(x) 


for all t G R>o, x, y G R", where ip 0 : R™ —»■ R is the zero 
terminal payoff defined by ipo(x) = 0 for all x G R ra . By 
inspection of (fl6l >. St ipo is the value function of a standard 
optimal control problem arising in « 5 ? 2 -gain analysis. It is finite 
valued if there exists a stabilizing solution of ARE (TTot . 

In developing a max-plus fundamental solution for DRE 
©, © via Theorem 13.61 it is useful to establish a connection 
between finiteness of the kernel G t of ( l36l > and controllability 
of the underlying dynamics ( fTSl ). 

Assumption 3.8: (A, B) of { 78} is controllable. 

Lemma 3.9: Suppose Assumption [3© holds. Then, the ker¬ 
nel Gt of the max-plus linear max-plus integral operator Gf 
defined by (l35l > satisfies the following property: 


Assumption 13.81 holds < 
Proof: See Appendix IQ 


G t (x,y) G R 
V t G R>o, x, j/gR" 











E. Max-plus fundamental solution for DRE (0) 

Dynamic programming implies that the set of dynamic 
programming evolution operators {S f }teR >u defines the well- 
known Lax-Oleinik dynamic programming semigroup 02). 
Applying Theorem l3.6l it immediately follows that {<?®}teR> 0 
must also define a one-parameter semigroup of operators via 
(135) . In particular, {C?®}teR >0 naturally inherits (from the 
Lax-Oleinik semigroup) the semigroup and identity properties 

g® gf = gf +T , g ® = i © , (40) 


for t,T G M>(). This particular semigroup is referred to as 
the max-plus primal space fundamental solution semigroup for 
the optimal control problem (fl5l >. see f9), H22I . The modifier 
primal used here refers to the fact that propagation occurs 
in the primal space of payoffs. (A corresponding max-plus 
dual space fundamental solution semigroup also exists, where 
propagation occurs in a dual space defined by the semiconvex 
transform ( fTll . see for example Q, ®, (9j, ll22) . liTOl .) 

In the specific case of the optimal control problem defined 
by 03, the properties (135) and ( 140) may be used to directly 
propagate the value function Wt to longer time horizons, with 

w t+T = gfw t , w t = gfif (4i) 


for any t,r, t + r G [0,f*(Po)). In view of ( IT9) and (l4l) . 
a particular solution P t of DRE © satisfying the initial 
condition © can be similarly propagated forward in time. This 
gives rise to a characterization of P t in terms of the Hessian 
of the kernel Gt of the max-plus primal-space fundamental 
solution gf. This characterization is referred to as a max-plus 
primal space fundamental solution for DRE ©. 

Theorem 3.10: Under Assumptions 13. II and 13.81 there exists 
a bijection n : S 2nx2n —> § 2nx2ra SU ch that the kernel G t of 
(|36) takes the explicit finite quadratic form 


Gt(x, y) = \ 


! 



el, (42) 


for all x, y G R™, t G M>o, where Qt is as per (122b . 

Proof: See Appendix [D] ■ 

By inspection of Theorems 13.31 and 13.101 the controllability 
Assumption 13.81 implies that the symplectic fundamental so¬ 
lution E t and the Hessian A t of the max-plus primal space 
fundamental solution kernel Gt are equivalent. In particular, 
there exists a bijection n _1 oS : R 27ix2ra —S 2nx2n suc j 1 


A t = n -1 o S(E t ), E t = S- 1 on(A t ) (43) 


for all t G K>o. Consequently, it is natural to expect that A t 
defines an alternative fundamental solution for DRE ©. ©. 

Theorem 3.11: Suppose that Assumptions D.ll and lXSl hold. 
Given any Po G the corresponding unique solution If 

of DRE ©. © exists and is given explicitly by 

P t = A] 1 - A] 2 (P 0 + A 22 )~\A\ 2 )', (44) 

for all t G (0,f*(Po)), where A t G S 2nx2n is as per (142) . and 
the maximal horizon of existence is t*(Po) gR+ 0 is 

t*(Po) = sup {t G E >0 | Po + A 22 G } . (45) 

Proof: See Appendix [E] ■ 


By inspection of ©, ©, and (142) . (144) . it is evident 
that the symplectic and max-plus fundamental solutions both 
provide a characterization of all particular solutions of the 
DRE ©, ©. Furthermore, both provide characterizations of 
the corresponding finite escape time t*(Po) G R® 0 , see © 
and (145) . However, by inspection, a crucial difference between 
these latter characterizations concerns their ease of evaluation, 
assuming their respective fundamental solutions are known for 
all time. In particular, the existence or otherwise of a finite 
escape at time t due to an initial condition Po G can 

be verified using the max-plus characterization (145) by testing 
the inequality P 0 + A 22 G §" 0 ™ once. However, the same 
verification using the symplectic characterization © requires 
testing invertibility of E* 1 + E^ 2 P 0 for all s G (0,t]. 


IV. FUNDAMENTAL SOLUTIONS SEMIGROUPS 
Both the symplectic fundamental solution E t G R 2n x 2,1 and 
the max-plus fundamental solution A t G § 2nx2n , specified 
respectively by ©, ©. provide a path for establishing 
existence of a unique particular solution P t of DRE ©, © 
on the time interval [0, t] G R>o, t G R>o, and computing 
that solution. As the term fundamental solution implies, this 
is possible for any initial data Po satisfying 0. Indeed, 
both fundamental solutions can be evolved to longer time 
horizons independently of any specific initial data for the DRE, 
thereby giving rise to a corresponding symplectic and max-plus 
fundamental solution semigroups of matrices. In defining the 
latter max-plus fundamental solution semigroup, it is useful to 
define a matrix operation © acting on A, A G § 2nx2n by 

[A ©A] 11 = A 11 - A 12 (A 11 + A 22 ) + (A 12 )', 

[A© A] 12 = —A 12 (A 11 + A 22 ) + A 12 , 

[A©A] 21 A ([A©A] 12 )', ‘ 40i 

[A © A] 22 = A 22 - (A 12 )'(A n + A 22 )+A 12 , 

using the notation of ©, in which (•)+ denotes the Moore- 
Penrose inverse. 

Theorem 4.1: Under Assumptions 13.II and 13.81 the families 
of matrices {E t } teK>0 and {A t } teK>0 defined by © and (03, 
and related via the bijection n _1 o 5 of (143) . define a pair of 
one-parameter semigroups of matrices in R 2nx2ra satisfying 

Si+s = E t E a) A t+S = Aj © A s , (47) 


for all t, s G K>o, in which the respective associative binary 
operations are standard matrix multiplication, and the matrix 
operation © of 06). 

Proof: Fix f,sG R>o The left-hand semigroup property 
in 03 is immediate by definition © of the symplectic fun¬ 
damental solution E t . With Assumptions 13. II and 13.81 asserted. 
Theorem 13. 101 implies that A t ,A s ,A t+s G § 2rax2ra are well- 
defined by (143 . while 03 holds with bijection n _1 o 3 by 
Theorems 13.31 and 13.101 Furthermore, Theorem 13.61 and (140) 
imply that for any if G dom C dom (f?®), 


g?Qfif= / G t (;r,) 


/*® 

/ G s (r], y) ©> if(y) dy 
VR" 


dr] 


/*® r /*® 

/ / G t {-,ri)®G a {r},y) 

JR n LJR n 


drj 


© ip(y) dy 
















= u 


t+s 


/*® 

i>= Gt +s (-,y)®i/j(y)dy. 

J K» 


Applying an appropriate modification of fT] Lemma 4.5] to 
equate the kernels of the left- and right-hand sides above. 
Theorem 13. 101 implies that 


x 

y 


A 


t-\-S 


= G t+S (x,y) 


G t (x, rj) 0 G s (r],y) dp 


JR n 


R n 


X 

f 

A t 

X 

0 b 

n 

/ 

A s 

y 

y 


V 


y 


y 


dr\ 


R n 


K, v (v)dy 


(48) 


where A 


x,y ■ 


^x,y{V ) — 2 


X 

/ 

y 


. y . 



is defined for each x,y £ 

0 

0 A? 2 


by 


A t n 


L (M 2 y K 2 


A t 12 


(A} 2 )' 


Aj 1 + A? 2 


t 



X 


y 


. y . 


= L v / (Al 1 +A 2 t 2 )r l + ri / 


A] 2 

r "i 

X 

[ (A} 2 )' J 

-1 

s* 

_1 


1 

X 

/ 

[ A} 1 

0 


X 

2 

. y. 


0 

A 22 

s 


. y . 


for all p £ R". As A t+S G 


2n X2n : c 


well-defined by (142b . 


note that Gt+ S (x,y) G R for any x,y G R” fixed, see also 
Lemma 13.91 That is, sup^gjjn \ x , y {y) £ R- Consequently, 
applying J8] Lemma E.2], the following properties hold: 

1) A} 1 + A 22 G 

2) the Moore-Penrose pseudo-inverse (A} 1 + A 22 ) + G 
exists; and 

3) there exists a rj* £ R” given by 


^ = -(A 22 + A“) + 


A\ 2 

(a 12 y 


x 

y 


i 

J R 


such that 

© 


i 

X 

/ 

' A} 1 

0 

2 

. y. 


0 

-1 

C4 

(M co 

<4 


A t 12 

(A} 2 )' 


(A“+A 22 )+ 


A] 2 

(A} 2 )' 


x 

y 

X 

y 


Applying this last property in (148} and recalling that x. y £ 
are arbitrary yields 06} via 


At+ S — 


[A} 1 

0 


■ A t 12 ■ 

0 

A 22 


[ (A s 12 )' J 


(Ag 1 + A 22 ) + 


A\ 2 
(A s 12 )' 


The semigroups properties 07} also naturally define respec¬ 
tive notions of exponentiation. In particular, 

S t = (£,)*, E 1 = exp(W), 

A t = (Ai) @t , Ai = II -1 o 2 o exp (H), 

in which H , S, II -1 are as per (0, (|6H . (l74l) . and the expo¬ 
nentiations (•)*, (-)®* denote (respectively) the standard matrix 
exponentiation, and an exponentiation defined with respect to 
the © operation of (l46l >. see fT] Section 5] and Remark 14.21 


below. As is the case with standard matrix exponentiation, note 
that d47l) . (1491) imply that 

(Ai) ©(t+ s ) = A(+s = A(@As = ( Al )® t ©(A 1 )® s . 
for all t, s £ R>o- 

Remark 4.2: J71 Section 5] The semigroup property (l47l) 
immediately facilitates the definition of ©-exponentiation for 
any positive integer n £ N by 

(A r )® n =A t ©A t ® • • • ©A T = A nT (50) 

v ^ 

n times 

where r G R>o- By inspection, ((A T )® m )®" = (A T )® mn for 
all m,n £ N. Using this observation, ( 150b can be extended 
to positive rational and subsequently positive real exponents. 
In particular, given p G Q>o and coprime m,n £ N such 
that np = m, (l50b implies that (A r )® m = A mn ( T / n ) = 
((A T / n )® m )® n = ((A r )® p )® n , That is, the positive rational 
©-exponent (A r )® p is uniquely defined by 

(A r )®^ = (A r/ „)® m (51) 

for all p = m/n £ Q>o, m,n £ N coprime. As Q is dense 
in R, and the map r i —> A r , r G R>o, is continuous by (03), 
it immediately follows that A t = lim pe Q >0jP _ >t A p . As A p 
can be replaced with the ©-expononent (Ai)® p of ( IFTT ). the 
©-exponent (Ai)® 4 of ( l49b is uniquely defined by 

(Ai)® 4 = lim (Ai)® p = lirn (A 1/n )® m (52) 

peQ>o,p->-t p6Q>o,p->t 

for all t £ R>o, identically to J7)- Note that in the right-hand 
equality of ( l52l ). coprime rn, n G N are uniquely defined for 
each p £ Q>o in the limiting sequence. Where t £ R>o is 
irrational, it follows immediately that m, n —> oo. 

V. SOLVING THE DRE ©, © 

Theorems 13.111 and 14.11 together describe a new max-plus 
primal space fundamental solution semigroup of matrices 
{A t } tgR>0 for propagating solutions P t £ 8 nXT1 of DRE © 
forward in time t G R>o from initializations Pq £ as per 
0. In particular, (l46l) . ( 1471 ) describe propagation of the new 
fundamental solution for this DRE, while (1441 specifies how 
this fundamental solution may be used to evaluate a particular 
solution at any time t £ R> 0 . In addition, 05} provides a 
general characterization of the corresponding maximal horizon 
of existence t*(Po) £ R> 0 - inspection, this characteri¬ 
zation allows easy verification of whether a specific time t 
falls before a finite escape t*(Po) £ R>o (if it exists), by 
testing if Pq + A 22 G at that time. This is simpler than 

the corresponding verification using the characterization 0 
provided by the symplectic fundamental solution 0, where 
invertibility of a matrix over a range of times must be tested. 


A. Recipe 

A recipe that uses the one-parameter max-plus primal space 
fundamental semigroup {A t } tgR>0 to compute the solution P t 
of DRE 0 for any initialization 

P 0 £ © 






























































of the form 0, using a fixed time step 5 £ R>o, is as follows: 

I. Initialize and propagate the semigroup (1461 . (07) 

O (Initialize basis) Select M £ g nxn 0 f 0 using Lemma 
13.41 Check that Assumptions 13.11 and 13.81 hold. 

© (Initialize semigroup) Fix time step 6 £ R>o and maximal 
time horizon t = KS £ R>o for some fixed K £ N. 
Using the matrix operators S, II -1 of (161 b . ( l74l >. initialize 
an element of the semigroup by 

Ag = II” 1 o-o exp(P5) £ § 2nx2n , ( 53 ) 

where H £ R 2nx2 ” i s the Hamiltonian matrix 0. 

© (Propagate semigroup) Compute a subset of 

the semigroup, corresponding to a temporal grid defined 
by R>o, via the evolution 

A(fc +1 )a = A«5 © A k s, k £ N<_r-, (54) 

as per 63. (See also Remark ED below.) 


II. Solve the DRE 0, 0 

0 (Initialize a solution) Select Pq £ Set k = 1 . 

© (Test for finite escape) If P 0 + Aj( 2 G as P er 63 

then evaluate the solution P k g at time step k as 

P kS = A ll - A % (Po + A 22 )" 1 ^ 2 )' (55) 

as per da. Otherwise, record a finite escape time as 
occurring in the interval (( k — 1)5, kS] and exit. 

© (Iterate) Increment /,:. If k G N< k then go to step ©. 
Otherwise, exit. 


As indicated, the recipe consists of a total of 6 steps, 
divided into two parts. Part I concerns the initialization and 
propagation of a subset of the one parameter semigroup of 
matrices (At}tgR >0 required for computing any particular 
solution of DRE d3. (0 up to a pre-specified time horizon 
t £ R>o- Part II concerns the subsequent evaluation of such 
a particular solution (and corresponding finite escape, if it 
exists). Crucially, part I need only be completed once, with the 
elements of the semigroup computed there used repeatedly in 
part 11 in evaluating any particular solutions of interest, without 
modification. This is demonstrated by example. 

Remark 5.1: For fast propagation of A k g to large k £ N< a', 
where K = 2 N , N £ N, the linear time-index accumulation 
in d54l) can be replaced with time-index doubling [10), ie. 

A(2*+!)<5 = A(2 k)S ® A(2^)5- « G {0} U N < n- 


B. Example - no finite escape 

In demonstrating the recipe described above, an example 
from m is considered. In particular, define A £ R raxn , B £ 
R” xm , C £ R pxn , and n = m = p = 2, by 

+0.216 -0.008 0 
-0.008 +0.216 J ’ 

+0.651 -0.310 ' 
-0.310 +1.160 ’ 


-2.000 

+1.600 

-1.600 

-0.400 

+1.500 

+0.200 

+0.200 

+1.600 


where M 0 £ S" (j” is the corresponding stabilizing solution of 
ARE ( [30b as per Lemma [+4l In view of ( 130 . select 


M = 


- 1.000 - 0.200 

- 0.200 - 1.000 


G § 


nxn 
<Mq ’ 


Consequently, Assumption 13.11 holds. Step O is completed 
via a standard rank calculation to verify that Assumption 13.81 
holds. Theorems 13.31 13.101 and 14. II subsequently imply that the 
one parameter semigroup of matrices {A t } tg R >0 propagated 
by ( l46t , ( |40 is well-defined and may be computed as indicated 
in steps ©, ©. With 6 = 0.05, K = 80, t = 4, |[53j yields 


-83.48 

-3.021 

+92.26 

-4.011 ‘ 

-3.021 

-91.11 

+11.07 

+92.42 

+92.26 

+11.07 

-102.6 

-3.420 

-4.011 

+92.42 

-3.420 

-94.28 


Subsequently iterating via (f54t as per step © yields the 
required set of matrices {A/c 5 }fc 6 N <ft: . 

In order to demonstrate the computation of particular solu¬ 
tions of DRE (Q in steps 0 - ©, select an initialization 


Po = -0.1 1 G (56) 

as per step 0 and ©. Iterating through k £ N < k as per 
steps © and ©, testing for finite escape and applying ( f55l >. 
yields the computed solution P k $, k G N <K of DRE 10. ( l56l >. 
This solution, along with corresponding symplectic and RK45 
solutions, is illustrated in Figure 0 (Here, the MATLAB™ 
RK45 solver is used, with absolute and relative tolerances 
set to 10 -12 .) All three solutions are in reasonable agreement. 
No finite escape is observed. 


C. Example - finite escape 

In order to illustrate finite escape phenomenon, the set of 
matrices {A^jfcgp^^. computed above is reused to evaluate 
the particular solution of DRE 0. 0 for the initial condition 

_ r 2.000 0.000 

~ [ 0.000 6.500 

The problem data is otherwise unchanged. Using the initial¬ 
ization (l57l > in step © and iterating steps © and © yields the 
corresponding DRE solution. A finite escape is demonstrated 
to occur within the horizon t = 4 of computation, with 
t*(P 0 ) £ (2.8, 2.9] established using d45l >. Figure 0 illustrates 
CTmax(-Po + Af 2 ), t = kS, k £ N<if, where er max : S nxn ->• R 
denotes the maximum eigenvalue map. Note specifically that 
zero crossing occurs at the finite escape time, as per (l45l >. 
Note further that t i-+ <7 max (-Fb + A 22 ) defines a monotone 
non-decreasing function. This monotonicity follows from that 
used to establish the representation (l45l > of the finite escape 
time f*(P 0 ), see the proof of Theorem 13.1 II It guarantees that 
no finite escape occurs prior to this zero crossing. 

The computed solution P t of DRE 0, ([50 for t = kS, k £ 
N<k- is illustrated in Figure 0 along with the corresponding 
symplectic and RK45 solutions. These solutions are in good 
agreement, as measured by the absolute errors illustrated in 
Figure 0 As may be observed in the latter figure, these errors 
increase immediately prior to the finite escape time as the 
entries of P t £ § nxn diverge to ±oo. For brevity, an error 
analysis is not included. 


icmxn 
t S)> M . 


(57) 
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Fig. 3. Max-plus and RK45 solutions of DRE {T}. <571 . 



Fig. 2. Maximum eigenvalue map t H > <T max (Po + A 22 ), t = kS. 
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Fig. 4. logjodl ■ || 2 ) of errors between solutions of DRE IT1 . {57}- 


VI. CONCLUSIONS 

A new fundamental solution for a class of differential 
Riccati equations (DREs) is developed using tools from max- 
plus and semiconvex analysis. It is shown that this fundamental 
solution is defined by a corresponding fundamental solution 
semigroup, which describes the evolution of all particular solu¬ 
tions of the DRE, on all time horizons. A new characterization 
of finite escape time is also provided, enabling a simpler test 
for existence of particular solutions in comparison with the 
standard symplectic fundamental solution. 

Appendix 

A. Proof of Theorem li.il 

Since Q t G R 2nx2n satisfies DRE {22}, C0 for all t G R> 0 , 
see {28}, it may be represented by a corresponding symplectic 
fundamental solution of the form {5}. denoted here by E t G 

R 4rax4n . In order tQ app j y Q define fl /\£ R 4nx4n by 


u = 

- A 

- BB’ ' 

A ‘ 

I 

0 

0 

0 

0 

I 

0 

0 

C’C 

A! 

! A — 

0 

I 

0 

0 





0 

0 

0 

I 


where A G R 2nx2n , B G R 2nxm , C G R px2n are as per {H- 
Note by inspection that A = A' = A -1 . By substitution, a 
straightforward calculation yields that 


U = A 


where H G R 2nx2ll J 

fundamental solution Ef for DRE 


n 

0 ' 

0 

0 

per 

0. 


A. 


is, again by {5}, 


E 
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exp('Hf) = A 


exp {Tit) 

0 ' 
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r s t n o 

to 
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E t 

0 ' 

A = 

0 / 

0 0 

0 

I 

E 2i 0 

0 0 

o 

0 / 


(58) 


for all t G R>o, where the notation of {3} has been applied. 
Hence, the particular solution Q t of DRE {22}. {23} is given in 
terms of the symplectic fundamental solution (0, with respect 
to E t , by 


Qt = Y t Xf 1 


(59) 
































































for all t £ [0,£*(Qo)) = R>o> see (EBJ- in which 


' x t ' 


Zt 

I 



Y t 


_ p(M) _ 




' E 

11 
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Ef 0 1 
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0 
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E 22 0 


+M 

-M 
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0 
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-M 

+M 


' E t n + E t 12 M -E t 12 M ' 
0 / 
S 2i +S 22 M -E 22 M 
—M +M 


€ R 


4nx2n 


(60) 


and i-i(M) is defined by (fTTTb . For any fixed t £ R>o, note in 
particular that 



(E t n + Ej 2 M) -1 (E t n + Ej 2 M) _1 Ej 2 M 
0 I 


As Mo is the stabilizing solution of ARE (l30l >. note that Rt = 
Mo is the unique solution of this DRE for all t £ R>o- That is, 
t*(Mo) = +oo. Choose any invertible M £ § nxn such that 
(OH holds, and note that such a choice is always possible. 
Recalling El, let Q t n £ S nxn , t £ [0,f*(M)) denote the 
unique solution of DRE (l25l > initialized with Qq 1 = M. As 
DREs (l25l > and ( |63] > are identical. Lemma lA. 2 1 and (OH imply 
that solutions Ql 1 and R t satisfy the monotonicity property 

Qt 1 -Rt = Q] 1 - Mo £ (64) 

for all t £ [0By inspection, this provides an upper 
bound for Qj 1 . In order to determine a lower bound, choose 
w a = 0 for all s £ [0, t] suboptimal in the definition (l20l > of 
S t {x,0). Recalling ©, O, (ED, 

\x'Q\ x x = St(x, 0) > \x'O t x, (65) 

in which O t £S nxn is well-defined by 


in which (E* 1 + Ej 2 M) _1 is well-defined as t*(M) = +oo 
by Assumption 13.11 and (l28l) . That is, Xf 1 is well-defined. 
Its substitution in ( l59l >. along with Y t from ( l60l >. yields Q t = 

Y t Xf 1 = E(Et), where E : R 2nx2n R 2 nx 2 n is de fined by 


S(E) = 

dom (S) 


r S n (E) S 12 (E) 1 
S 21 (E) S 22 (E) 


|e <E K 2nx2n 


E 11 + E 12 M £ R nxn 

invertible 


using the notation of 0- with 


S 11 (E) = (E 21 + E 22 M)(E n + E 12 M) _1 , 
S 12 (E) = S 11 (E) E 12 M - E 22 M , 

S 21 (E) A —M(E 11 + E 12 M) -1 , 

S 22 (E) A S 21 (E) S 12 M + M. 


(61) 


As M is invertible by Assumption 13.11 it may be verified 
directly that S of ( ICO ) is invertible, with S -1 : ]R 2rlx2rl —>. 

R 2nx2n gjven by 


S- 1 ^) A 
dom(S- 1 ) 


(S- 1 ) 21 (Q) \ 


(62) 


Q £ 


p2nx2n 


Q 21 £ 


invertible 


where 

(S- 1 ) 11 (Q) A-(Q 21 )- 1 Q 22 
(S- 1 ) 12 (Q) A -(Q 21 )- 1 (M - Q 22 )M- 1 
(S- 1 ) 21 (Q) a V 11 (E~ 1 ) 11 (Q) + Q 12 
(S - 1 ) 22 {Q) a Q 11 (S- 1 ) 12 (Q) - Q l2 M~ l . 

That is. (l29l > holds. ■ 


B. Proof of Lemma 13.41 

Fix Mo £ as the stabilizing solution of ARE (|3(H ) 

indicated in the lemma statement. Let i*(Mo) GR+o denote 
the maximal horizon of existence ([6]» of the DRE 

R t = A 1 R t + R t A + RtBB'R t + C'C, R 0 = M 0 . (63) 


O t = f exp (A! s)C'C exp(A s) ds + exp(A'f) M exp(A t) 
Jo 

for all t £ R>o- Note that O t £ S nxn is finite for all t £ 
R>o, and provides a lower bound for Q] 1 £ S nxn . Hence, 
combining (l64l > and ( 1651 . 


Qt 1 e § 


nxn 

>Ot 


ns 


nxn 

<M 0 


for all t £ [0 ,t*(M)). A simple contradiction argument 
subsequently implies that Q] 1 G S nxn is finite for all t £ R>o, 
so that t*{M ) = +oo. ■ 


C. Proof of Lemma 13.91 

Suppose that Assumption 13.11 holds. Fix x,y £ M™, t £ 
R>o- Note that Gt(x,y) £ R~ by Theorem 13.61 

(Necessity) Suppose that Gt(x,y) £ R. Recalling the value 
function interpretation of Gt(x,y), if the dynamics (IT8l > are 
not controllable from x to y in time t, it immediately follows 
by definition (l36l > that Gt(x,y) = — oo. Hence, the dynamics 
dH must be controllable from x to y in time t. Necessity 
follows as x, y £ R” and t £ R>o are arbitrary. 

(Sufficiency) Suppose that dynamics are controllable. 
Consequently, Lemma IA.1I implies that Q 22 G where 

Q 22 is as per (l27l >. Consequently, St(x,-) £ SPff M = 
dom (fD v ), so that T> v St(x,-) £ SPZ M is well defined. So, 
applying the semiconvex transform (fTTI) to S t (x, •) yields 


( V v S t (x , -)){y) = - f (p(£, y) <8> {~S t (x, 0) 

J R" 
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( 66 ) 


where (M — Q 22 ) -1 is guaranteed to exist by Lemma lA.ll 
so that A t £ IR 2 ”' x 2n by definition. Hence, applying the right- 
hand equality of ( |36| > of Theorem 13.61 


G t (x,y) = 3 


/ 



G R, 


(67) 


thereby completing the proof. ■ 

Lemma A.l: Under Assumption 13.11 controllability of the 
dynamics (fl 8 l > implies that Qf £ 8™)^ for all t G R>o- 

Proof: (Lemma 1/4./l l With M £ 8" xn satisfying Assump¬ 
tion 0T| recall that t*(M) = +oo as per (f28l> . Consequently, 
the optimal dynamics associated with St(x,y) of (l20l >. (I2H 
are well-defined by the time-dependent ODE 


x* s = (A + BB'Qli a ) x*, x 0 = x, ( 68 ) 


for all s £ [0, t]. Let Vt : A 0it —> R" xn denote the evolution 
operator associated with (l68l >. with Ao,t = {(r, s) £ R> 0 | 0 < 
r < s < t}. By definition, see for example lP3l Proposition 
3.6, p.138], 


V t (cr,cr) = I, 

&V t {8,<r) = {A + BB'QlljVtM, (69) 
&V t (a, a) = —V t (s, a) (A + BB'Ql 1 -*), 
for all (s,cr) £ Ao,t- Define U t : Ao,t —> R” xra via (l69l > by 
U t (r,T) = V t (t - r,t - r)' (70) 


for all (r, r) G Ao,*. By inspection of (f69t . (f70t . 

= I, 

Wr U ^ T ) = [^ V t( S ^)|( s , CT ) = ( t _ r , t _ r )]'(- 1 ) 
= {A + BB'Q^yVtf-TA-r)' 
= (A +BB’Ql 1 )'U t (r,T), 
&Ut(r,T) = [^V t (a ) (7)|( ii(7 ) = ( t _ Tit _ r )] , (- 1 ) 
= -Vt(t-r,t~r)'{A + BB'Q 1 T 1 )' 
= -U t {r,r) (A + BB'Ql 1 )' 


(71) 


That is, Ut : Ao,t —> R nx " is the evolution operator for the 
dynamics associated with (A + BB'Ql 1 )', s £ [0,f]. Compar¬ 
ing with (l26l> . it immediately follows that Q l' 2 = — Ut(s , 0)M 
for all s G [0,i]. Hence, < 127 b implies that 

Qf-M= [ (Qf)' BB'Q 12 ds 
Jo 

= [ MU t (s,0)'BB'U t (s,0)Mds = MC t M (72) 
Jo 

where C t = / 0 * Vt(i, t — s)BB' Vt(t, t — s) ds £ 8>g" is the 
controllability gramian for the pair (A+BB'Qf., B) on [0, t], 
by definition of V*. However, recall that controllability is pre¬ 
served under state feedback, see for example E p.48]. Hence, 
(A, B) completely controllable implies that (A+BB'Qf., B) 
is completely controllable, which in turn implies that Ct is 
invertible for t £ R>o. That is, Ct £ S"q" for all t £ R>o- As 
M is invertible by Assumption 13.11 the assertion immediately 
follows by d72l . ■ 


D. Proof of Theorem 13.701 

Fix any t £ R>o, x £ R”. Applying Lemma [3791 and in 
particular (l66l >. (l67l) . it follows immediately that Q t G R 2rix2rl ; 
A t £ S 2 " x2n of m , ® are related via 

Qt = n(A t ), At = H~ 1 {Q t ), 

with matrix operators n^” 1 : S 2nx2n —> § 2rax2n defined 
using the notation of (O by 


n(A) = 

'A 11 - A 12 (M + A 22 )" 1 (A 12 )' A 12 (M + A 22 ) _1 M 

M(M + A 22 )" 1 (A 12 )' M - M(M + A 22 )~ 1 M 


dom (n) = < A G § 


A 22 f— (onxn 

a e ^<_m < > 


(73) 


n ~\Q) = 

Q n + Q 12 {M - Q 22 )" 1 (Q 12 )' Q 12 (M - Q 22 )- 1 ^! 

M(M - Q 22 )- 1 (Q 12 )' M(M - Q 22 ) _ 1 M- M 


dom (n x ) = < Q £ S' 


^2nx2n 


Q 22 G S': 


>M 


(74) 


It may be verified directly that non 1 is the identity. 


E. Proof of Theorem 13.771 

Throughout, it is assumed that Assumptions 13.11 and 13.81 
hold, with M £ S nxn specified by the former, as per the 
theorem statement. Note in particular that t*(M) = +oo, so 
that (E) 1 + E 12 M) _1 exists for all t £ R>o, where E t is 
the symplectic fundamental solution identified in (0. Conse¬ 
quently, Q t £ § 2nx2n is well-defined as the unique solution 
of DRE (ESl. ([23]>, for all t £ R> 0 by Assumption 13.11 see 
Theorem 13.31 and its proof. Note that Pq £ 8"^ = dom (T) 
by hypothesis and (fTH . 

The proof proceeds by demonstrating a sequence of impli¬ 
cations concerning the following claims, posed with respect 
to arbitrary fixed t £ R>o and Po £ ^>m* : 

7) t £ (0,t*(P 0 )); 

2) T(P 0 ) + Qf £ §^ x " for all s G (0,t]; 

3) T(P 0 ) + Qf £ §"o"; 

4) P 0 + A 22 G §<o n ; and 

5) (HI and (05) hold. 

In particular, it is shown that 1) <& 2) *=> 3) 43- 4) => 5). 

2) =>■ 1): Suppose that T(Po) + Qf G §"q" for all s £ 
(0, t]. Applying (IT3l> and Theorem 13.31 

M-\T{P 0 ) + Qf)M- 1 
= (M — Po) -1 — (S^ 1 + Eg 2 Af) _1 Eg 2 (75) 

where it may be noted that the inverses on the right-hand side 
are guaranteed to exist. By hypothesis, the left-hand side is 
invertible, so that a matrix K s £ M" x n is well-defined for an 
arbitrary s £ (0, f] by 

K s = (E^ 1 + E fM)- 1 + (E^ 1 + E 22 M) _1 Ej 2 

x [(M - Po)" 1 - (E 11 + E 12 M) _1 E 12 ] -1 
x (E 11 + E fM)- 1 . 




















However, the Woodbury Lemma implies that 

I< s = [(S 11 + E 22 M ) - E f(M - Po)]' 1 

= (s i 2 + s i 2 p o) - i _ 

That is, Ej 2 + E 12 / J ( > £ S nx " is invertible. Recalling ©, and 
that s £ (0, t\ is arbitrary, immediately implies that 1) holds. 

1) =>■ 2): Fix an arbitrary t 6 (0,i*(P o )). Analogously to 
the proof of Theorem 13. 31 let Q s £ S 2n22n denote the unique 
solution of DRE (l22l > subject to the initialization 

Qo = n(Po) ( 76 ) 


defined, via (flOl i. for all s £ [0, f*(Qo))> where t*(Q 0 ) £ 
K>o is the corresponding maximal horizon of existence ©. 
Analogously to the argument yielding ( l28l >. observe that 
t*{Q 0 ) = t*(P 0 ), so that t £ (0,t*(Qo))- An application of 
the symplectic fundamental solution ([4}, (01, (f58l) . yields 

Q s = YsX- 1 (77) 


for all s £ [0,t], in which 



I 

tiPo) 


E 11 0 

E 12 0 1 


\ 1 0 

0 I 

0 0 


0 I 

E 21 0 

E 22 0 


+Po -M 

0 0 

0 I \ 


_ -M +M 


E 11 + E 12 P 0 

-E 12 M 1 

0 

/ 

E f + E 22 P 0 

-E fM 

-M 

+M 


for all s £ [0,i]. In particular, 
v—i = [ (£ s n + S^Po)" 1 (Ej 1 + E 12 Po) _1 S 12 M ' 

[ 0 I J ’ 

in which (E 11 + E 12 Po) _1 is well-defined for all s £ [0, t], 
as t £ (0,P(Po)), see (0). Consequently, recalling (0J. (fTTb . 

Qf = M — M{ E 11 + E 12 P 0 ) _1 E 12 M (78) 


is well-defined for all s £ [0, /:]. Recalling (l23l> and < 17 6b . as 
Qo = n( p o) — A t (A7) = Qo, monotonicity of DRE solutions 
(see for example Lemma lAPl ) implies that Q s — Q s £ §>q X , 
so that in particular 

Qf - Qf € (79) 

for all s £ [0,t]. Fix an arbitrary s £ (0, £]. Rearranging (l78l > 
and applying ( [79b . Theorem 13. 101 and Lemma |A. 11 

(E 11 + E 12 Po) _1 E 12 = M" 1 (M - Qf) M~ 1 
< M~fM - Qf) M~ l £ S^ n . (80) 

Theorem 13.31 and (|6H implies via the notation of (0 that 


Q 22 = [5(E S )] 22 = M- M(E 11 + E 12 M) _1 E 12 M. (81) 


Recall that E s £ dom (5) (ie. the inverse involved is guaran¬ 
teed to exist) by Assumption 13.11 as s £ (0 ,t*(M)) = M>o- 
Furthermore, as s £ (0,t*(Po)), definition (0 implies that 


E 11 + E 12 P 0 is invertible. Hence, a matrix L s £ § nxn is 
well-defined by 

L s = (M — P 0 ) + (M - Po)(E 11 + E 12 P 0 )- 1 E 12 (M - P 0 ) 
= (Af - P 0 ) + (M - P 0 ) 

x [(S 11 + E 12 M) - E 12 (M - P 0 )] _1 E 12 (M - P 0 ). 

where the second equality follows by adding and subtracting 
E fM within the inverse. Applying d80l >. and the fact that 
Po £ note that L s £ §™Q n by definition. The Woodbury 

Lemma subsequently implies that 

L s = [{M - Po)" 1 - (E 11 + E 12 M) _1 E 12 ] _1 
= M(T(P 0 ) + Qf)~ l M 

where the second equality follows as per (1751 1. Consequently, 
as M £ S nxn is invertible and L s £ 

T(P 0 ) + Qf = ML~ l M £ 

As s £ (0,t] is arbitrary, claim 2) immediately follows. 

2) =>■ 3): By hypothesis, T(P 0 ) + Q 22 £ §"o" f° r s e 
(0, t]. Selecting s = t yields claim 3) as required. 

3) => 2): By hypothesis, T(P 0 )+Q t 22 eS^". Furthermore, 
T(P 0 ) £ §™ Xn M by m. Hence, Qf £ S nxn , so that 
(Qf)'BB'Qf must be integrable with respect to c C [0. t] 
by definition (f27l) . In particular, 

Qf -M = f {QfYBB'Qfda 
Jo 

> f (. Qf)'BB'Qfda = Qf-M 
Jo 

for any fixed s £ (0, t]. Hence, Q 22 — Qf £ so that 

T(P 0 ) + Qf = (T(P 0 ) + Qf) + (Q 22 - Qf) £ S^". 

Recalling that s £ (0, t] is arbitrary yields claim 2) as required. 

3) => 4): Recalling (fT3l> and Theorem 13. 101 see ( 142k (f73l> . 

T(P 0 ) + Qf = (—M - M(P 0 - M) _1 M) 

+ (M-M{M + Af)~ 1 M) 

= M [{M - Po)- 1 - {M + A 22 ) -1 ] M. (82) 

Recalling that T(Po) + Qf £ by hypothesis, 

T(P 0 ) + Qf £ §<o" 

(M — Po)" 1 ~{M + Aff 1 £ 

^{M + Af) - (Af - P 0 ) £ 

^P 0 + Af £ . (83) 

That is, claim 4) holds. 

4) => 3): Note that (l82l i holds as per the 3) => 4) case 
above. By hypothesis, Po + A 22 £ §"g n . Hence, the string of 
equivalences (l83l > implies that 3) holds. 

4) => 5): Recalling (l35l > and ( 142k the value function W t of 
m, (U3 satisfies 

/*® 

Wfx) = \x'P t x = / G t {x, y) (8) ^(y) dy 

JR n 


P® 


/ 

r -| 

/ ^ 
jR n 

X 

. y. 

A t 

X 

. y. 




























/*® 

1 / 

X 

/ 

a 11 

A} 2 

X 

2 / 

jR n 

. y. 


[ (A 12 )' 

Po + A 22 

. y. 


dy 


for all x £ R n . By hypothesis, P 0 + A 22 £ S"g n , so that 
(P 0 + A 22 ) -1 exists. Hence, the above max-plus integration 
explicitly evaluates as 


3 x ' p t x = \ x ' [ A t n - A t 2 ( p o + A t 22 ) 1 ( A t 2 ) / ] x - 

As x £ K” is arbitrary, ( I44| i follows immediately. In addition, 
as 4) <(=> 1), it immediately follows that 

sup {f £ R>o |P 0 + A 22 £ §"q' 1 } 

= sup{f GM>o|i 6 (0,f*(Po))} =t*(P 0 ). 

That is. (145} holds. __ ■ 

Lemma A.2^ Given initializations Pq,Pq £ S n x ” satis¬ 
fying P 0 - P 0 £ S<Q n > the respective unique solutions 
P S ,P S £ S 2nx2n of DRE O defined for all s £ [0,t*), 
t* = min(f*(P 0 ), f*(Po)) satisfy 

Ps-PsG §T 0 n (84) 

for all s £ [0, t*). 

Proof: Fix s £ [0, t*). Recalling the notation of the proof 
of Theorem 13.101 let T : Ao,t R nxrl denote the evolution 
operator associated with the time-dependent ODE 

Y a = t A+\BB , {P a + P <J ))'Y a , 

defined for a £ [0,s]. In particular, note that 


T(a,a) = I, 

| -T(s , a) = (A+ \BB\P S + P S )Y T(s, a) 

^ T(s, a) = —T{s, a) (A + \BB'(P a + ?„))' 
for all <7 £ [0, a]. Define n : [0, s] —>• § nxra by 

7r CT = T(s,a)(P CT -P CT )T(s,a)' (85) 

for all o £ [0, s]. Differentiating with respect to <r, 

*« = £T(s,a) (P CT - P„)T(s,a)’ 

+ T(s,a) (P a -P a )T(s,a)' 

+ T(s,a)(P a -P a )£n Sl *y 

= T{s,o)T a T(s,a)' (86) 

for all a £ [0, s], where 

r CT = (p CT - p a ) - (A + \BB\p a + P a ))\p a - Pa) 

- (P a - Pa) (A + \BB\P 0 + Pa)) = 0 , 

in which the equality with zero follows by virtue of the fact 
that P a , P a both satisfy the DRE (jT}. Consequently, ([86} 
implies that 7r CT = 0 for all o £ [0,s], so that integration 
with respect to a £ [0, s] yields ir s = no. Recalling d85} . it 
follows immediately that 

P s -P s = TT s = ir 0 = T(s, 0) (P 0 - P 0 )' T(s , 0)' 

Recalling that P 0 — P 0 £ and noting that s £ [0,£*) is 

arbitrary, yields the required assertion (184} . ■ 
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